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by 
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Purdue  University 

1 .  Introduction 

Empirical  Bayes  rules  have  been  considered  for  multiple  decision 
problems  by  Oeely  (1965),  Van  Ryzin  (1970),  Van  Ryzin  and  Susarla  (1977), 

Singh  (1977),  and  Gupta  and  Hsiao  (1981).  Most  of  the  papers  are  concerned 
with  the  selection  of  the  best  population  where  best  is  usually  defined  in 
terms  of  the  largest  or  smallest  unknown  parameter.  Gupta  and  Hsiao 
(1981)  considered  the  problem  which  is  concerned  with  the  selection  of 
populations  better  than  a  control.  In  some  practical  applications,  one  may 
be  interested  in  selecting  populations  which  are  close  to  a  control.  We 
will  consider  this  kind  of  problem  in  this  paper. 

In  Section  2,  we  propose  a  general  Bayes  rule  for  selecting  good  popula¬ 
tions.  In  Section  3,  assuming  that  the  populations  are  uniformly  distributed, 
empirical  Bayes  rules  are  derived  for  both  the  known  control  parameter  and 
the  unknown  control  parameter  cases.  Under  some  conditions  on  the  marginal 
and  prior  distributions,  the  rate  of  convergence  of  the  empirical  Bayes 
risk  to  the  minimum  Bayes  risk  is  investigated.  The  rate  of  convergence  is 
shown  to  be  n“6^3  for  some  5,  0  <  6  <2. 


♦This  research  was  supported  by  the  Office  of  Naval  Research  Contract 
N00014-75-C-0455  at  Purdue  University.  Reproduction  in  whole  or  in  part 
is  permitted  for  any  purpose  of  the  United  States  Government. 
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2.  A  General  Bayes  Rule  for  Selecting  Good  Populations 

Let  ,itk  be  (k+1)  independent  populations  which  are  characterized 

by  parameters  0g,e^ . .e^,  respectively.  Assume  that  ttq  is  the  control 
population  with  parameter  9q  which  may  be  known  or  unknown.  When  9q  is 
unknown,  let  9  =  {6g,e^ . 8k)  and  X  =  (Xg,X1 ,. . .  ,Xk)  where  X^  is  an  observa¬ 

tion  from  TTj,  i  =  0,1,..., k.  When  eQ  is  known,  no  observation  from  population 
ttq  is  taken,  and  eQ,  Xg  are  deleted  from  e  and  X,  respectively.  When  there  is 
no  confusion,  e  and  X  are  used  to  represent  either  case.  We  define  population 
to  be  a  good  population  if  (e^-Sgl  <  A  and  a  bad  population  if  |e.-e0l  la, 
where  a  >  0  is  a  pre-assigned  constant.  Our  goal  is  to  find  a  Bayes  rule 
which  selects  all  good  populations  and  rejects  bad  ones.  We  assume  that  given 
9.,  Xj  has  probability  density  function  f(x^|e^)  with  respect  to  a  a-finite 
measure  u,  for  i  =  0,1,. ..,k,  and  e  has  a  prior  distribution 

G( e )  =  n  G.(e.)  on  the  parameter  space  Q.  Let  G  =  {s|sc  {1,2 . k}} 

i=0  1  1  ~ 

be  the  action  space  and  let 

(2.1)  L(e,s)  =  + 


c2(9i-eo-a>I{BO+A<0i>tei)1  *  Ilt)l'rV*lliv...t<»0i(,i) 


c4(90*a-e,)I( 


((e()> 


90<6i<eo+A}' 

be  the  loss  function  defined  on  n  x  G,  where  c^,  i  =  1,2, 3, 4  are  positive 
constants  and  I  is  the  indicator  function.  The  Bayes  risk  with  respect  to 
G  can  be  expressed  as 

(2.2)  r(G,s)  =  /  /L(e,s)f(x|e)dG(e)dp(x), 

Z  Si  ~ 


where  %  is  the  sample  space  and  f(x|e)  -  ^(x^e.). 


Since  the  action  space  is  finite,  attention  can  be  restricted  to  the 
non- randomized  rules  for  deriving  the  Bayes  rules.  For  a  non-randomized 
decision  function  5:  %  -*•  Q,  the  corresponding  Bayes  risk  with  respect  to 
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G  is  given  by 

(2.3)  r( G.6)  =  /  /L(e,6(x))f(x|e)dG(e)dp(x). 

2  a 

In  the  sequel  we  consider  the  special  case  where  c-|  =  C2  =  c-j  =  c^  = 
constant  which  can  be  taken  to  be  unity  without  loss  of  generality.  If  <p  is 
the  empty  set,  we  have 


L(e,*)  ■  -V»)I{V«<9,<e0)(6l)  + 


( Va-9i)I{90<Sj<e0*4){6i'  ), 


and  (2.1)  can  be  expressed  as 


(2.4) 


L(e,s)  =  L(e,<t>)  + 


l  UeQ-&-d.)I 
i€S 


(e.-e0-A)I 


{e.<e0} 
{0O<ei } 


(e,-)  + 

(ei)>. 


Hence,  for  any  6,  we  have 


(2.5)  r(G,6)  -  r( G,*) 

*  /  l  {/(en-A-e.)f(xt ©)dG(e)  + 

X  i€«(x)  n 

2  /{eo<e. }(0i-eo)f(x|e)dG(e)dv(x) >. 

From  (2.5),  «B(x)  is  given  by  i  6  60(x)  if 
(2.6)  /(eo-A-ei)f(x|e)dG(e)+2/{0o<0^}(9i-eo)f(x|e)dG(0)  <  0, 

then  «B(x)  is  a  Bayes  rule  with  respect  to  G. 
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Let  m^x^)  =  Jf(x- |e^ )dG.(e.)  be  the  marginal  distribution  of  X^, 

71  ( 9i  I xi )  ke  the  posterior  distribution  of  ei  given  =  x^,  and  E ( e ^  j x ^ ) 

be  the  expected  value  of  given  X^  =  x^ .  If  m^x^)  >  0  for  all  x^ ,  theh 

(2.6)  is  equivalent  to 

(2.7)  (e0-a)-E(ei|x1)  +  2/{0o<6. }(ere0Me.  lx.Jdej  <  0 
if  6q  is  known,  or 

(2.8)  E(eo|xo)-E(ei|xi)-A+2/{0o<0^}(ei-eo)ir(e.|xi)7r(eo|xo)deideo  <  0 
if  0q  is  unknown. 

From  the  above  discussion,  we  have  the  following  main  result: 

Theorem  2.1.  Under  the  loss  function  (2.4),  the  Bayes  rule  6g(x)  with 
respect  to  G  is  given  by 

(a)  If  eQ  is  known,  then  i  €  «B(x)  if  the  inequality  (2.7)  holds. 

(b)  If  0Q  is  unknown,  then  i  6  Sg(x)  if  the  inequality  (2.8)  holds 


An  Application: 

Suppose  that 

(2.9)  f(x1jei)  =  e  y/U.!),  Xi  =  0,1 . ei  >  0 

and  ei  has  a  prior  distribution  g ^ ( e  1- )  =  G!(ei )  which  is  given  by 


®j“l  "6j0j 

(2.10)  gi  ( e. )  =  6^9^  e  VrU^I^^e.) , 
where  >  0  and  6^  >  0  are  known.  Then 

Xj+a.  X.+a.-l  -0j(1+B4) 

(2.11)  tt(o1  |Xi)  =  (1+8^  1  y  1  e  1  1  /r(x.+ai) 


and 

(2.12)  E(et  jx1)  =  (x1+o^)/(1+b^). 


Lemma  2.2.  If  ir(e..|x..)  is  defined  by  (2.11),  then 

/{e0<e,)(6rV*(eilxi>d9( 

Vai 

=  1+e7  {1-r(0o(1+ei)ixi+ai+1)}-0o{1-r(eo(1+ei);xi+ai)}» 

where  6q  >  0  is  known  and 


r(a;  a )•!&-*  e"x 


h  rOT  e”<d,•  *  >  °>  *  *  °- 


Proof.  Proof  is  simple  and  hence  omitted. 

Lemma  2.3.  If  nCe^x^)  is  defined  by  (2.11)  and  B^  =  e,  i  =  0,1 . k  and 

6q  is  unknown,  then 


^{e0<ei  }<ereoMei  •xi),T(eolxO>deideO 

.  Hi.  ...  . .  fVV  „I 


where 


Rb - I(?;  V°0,xi+ai) - T+ir  I(2;  xQ+a0+1  ,xi+ai ) ’ 


I(z;  a,6)  =  £  xa‘1(l-x)8-1dx,  a  >  0  ,  b  >  0, 


B(«,e)  =  r(o)r(a)/r(a+B). 


Proof.  / {eo<e^ei'0O^ei  ixj)n(0olxo)dei<,eo 

-  7  7  (0  0)  d+B)Xi+ai+Va°  .vy'  Vv1  -(0i+9n)o+e)de  d 
6  eV  1  0  W^iTv^T  ei  6o  10 

_  1  (RB)Xl+ai+Xo+a°  „Vai+x0+a0,..  ,  *i+V]  -O+u)e0(l+B) 


r(xi+ai)r(x0+a0)  °0 


(u-l)u 
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1  7TCW71: — v  lU-UU  (l+U)  < 


K0  “0*xi  ai 


<xft»1+V“0)  \  „  . . -(x^+VV'’ WT. 

"IWTv^Tv^t  l  <i-v)(v*i)  v  d. 


(xi+ai+xO+ao) 


l  xi+ai_1  xn+an-1 

r(l-2s)(l-s)  1  1  s  0  0  ds 


(x.+a^+Xjv+afv)  ,  2(xn+an)  , 

=  1+6  ^2;  x0+a0’xi+ai ^  1+6  ^2;  V“0+1 ;  xi+ai^ 

From  Theorem  2.1,  Lemma  2.2  and  Lemma  2.3,  we  have  the  following 


theorem: 


Theorem  2.4.  If  f(x^ ) e - )  is  defined  by  (2.9)  and  ( 0^ )  is  defined  by 
(2.10).  Under  the  loss  function  (2.4),  the  Bayes  rule  6g(x)  is  given  by 

(a)  If  eQ  is  known,  then  i  €  6g(x)  if 


xi+ai 


{l-2r(e0(l+ei);  x^a.+l)}  -  e0(I-2r(e0(I+ei);  xi+«i)}  <  a. 
(b)  If  eQ  is  unknown  and  8^  =6,  i  3  0,1,..., k,  then  i  6  <$g(x)  if 


xi+ai  1 

'  1  f or / * 


Xa^CIa 

1+6 '  xo+ao,xi+ai^_1 }  +  1+6  {1  + 

21  (?;  Xq+Oq ,x^+a^  ) -41  (•jrl  Xq^Bq+I  »X^+a^) }  <  A. 

3.  Empirical  Bayes  Rules  for  Uniform  Populations 

In  this  section  we  will  assume  that  has  probability  density  function 

f(xil0i)  =  e~  i(o  e  ) ( xi ) »  where  0^  >  0  is  unknown.  Suppose  that  e  has  a 

prior  distribution  G(e)  °n  n  and  has  a  continuous  probability 
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density  function  gi  and  is  positive.  Let  m.(x.),  M^x^)  be  the  marginal 
pdf  and  cdf  of  X^,  respectively.  Then 

co 

(3.1)  m^x.)  =  /  gi  dGi(ei) 

xi  1 

and 

(3.2)  M.  (x. )  =  ximi(xi)  +  Gi(x.). 

From  (3.2) ,  we  have 

(3.3)  Gj ( x.j )  =  Mi ( x.. )  -  x.m.^). 

It  follows  that 

b  -I 

(3.4)  /  T-  dG.(e.)  =  m.(a)  -  m.(b) 

a  0i  i  i  i  i 

and 

/  dGi(e.)  =  m. (a) 
for  any  x..  <  a  <  b  <  ®. 


3.1.  0Q  known 

In  the  case  where  eQ  is  known,  let 

co 

(3.5)  ag  (x^  =  (0Q-A)m^(xi )-/  dG.(0i)+2 

i  xi  Uj  >' 

From  (2.6),  we  have  i  €  Sg(x)  if  aq  (x^ )  <  0. 


(ei-e0)ftxi!ei>dGl(ei) 

)n(  0q  »°°/ 


^  Xi  <  e0. 


(3.6)  ag  (x.)  =  (0O-A)mi(x.)-/  dG.(e.)+2  /(0r0o)  ^  dG^e^ 

i  Xi  0q  i 

=  ( 0Q-A-X. )mi (Xi )+l  -2Mi ( e0)+M. (Xi ) 

=Al,Gi(xi)  (say)> 


If  >  0g> 
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(3.7)  ag  (x.)  =  (e0-A)m.(xi)-/  dGi(ei)+2/  (ei-o0)  dG.(e1) 

ui  xi  xi  i 

=  (xi-e0-A)mi(xi)+l  -M^x.) 

-  a2  q^(x.)  (say) . 

Therefore 

(3.8)  5b(x)  =  {i|xi  <  60,AlfG  (x.)  <0)U(i!xi  >  90.A2fG.(xi)  <  0}. 

Remarks : 

(1)  aq  (x.)  is  strictly  decreasing  for  0  <  xi  <  eQ-A,  strictly  increasing 
for  eQ-A  <  xi  <  eQ+A,  and  strictly  decreasing  for  eQ+A  <  xi  (we  assume 
that  9g-A  >  0) . 

(2)  If  x •  >_  0O+A,  then  aq  (x^)  >_  0.  Hence  i  <£  6g(x)  if  xi  >_  eQ+A. 

(3)  If  Gi  is  such  that  1  -2Mi ( eQ)  +  M.(6q-a)  >_  0,  then  6 R ( x)  =  <t>. 

Otherwise,  i  6  6g(x)  if  (e()-A)-d1  <  xi  <  (eQ+A)-d2,  for  some  positive 
real  numbers  d]  and  d2-  Hence  this  type  of  selection  rules  are  Bayes 
rules  relative  to  some  prior  distribution. 

If  G  is  unknown,  the  Bayes  rules  are  not  obtainable.  In  this  case, 
we  consider  a  sequence  (X^a-j  ) ,  (X2,a2),...,  which  are  independent  pairs  of 
random  vectors,  each  a..  is  distributed  as  G  on  n  and  X..  =  (X.p...,X^)  has 
conditional  density  function  f(x|e)  given  A.  =  e.  The  empirical  Bayes 
approach,  which  was  introduced  by  Robbins  (1955),  attempts  to  construct  a 
decision  rule  concerning  An+^  at  stage  n+1  based  on  X-| , . . . , Xp+i .  The  risk 
at  stage  n+1  taking  action  6n(x;  x-j,...,xn)  =  6n(?)  1S  given  by 

(3.9)  rn(G,6n)  =  /En{  l  C/(e0-A-ei)f(x|e)dG(e)  + 

X  i€<5n(x)  n 

2  /  (ei-e0)f(xje)dG(e)]}dx  +  r(G,4»), 

(0O*”) 
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where  En  denotes  the  expectation  with  respect  to  the  n  independent  random 
variables  Xi*>*->Xn  each  with  common  density  function 

k 

m(x)  =  /f ( x | e)dG( e)  =  n  m.(x.). 
o  "  "  i=l  1  1 

Definition  3.1.  The  sequence  of  procedures  { <5n }  is  said  to  be  asymptotically 

optimal  (a.o.)  relative  to  G  if  rn(6»6n)  -  r(G)  =  o(l)  as  n  ■*  ®,  where 

r(G)  =  inf  r(G,6). 

6 

In  order  to  find  an  a.o.  sequences  of  rules,  let 

«1  B(x)  =  { i | xi  -  eo,Al ,G. ^xi ^  <  0}  and  62  B^  =  {ile0  <  xi  <  eo+A> 

a2  G  ^xi^  <  0}'  From  (3*8)  and  Remarl(  (2).  we  have 

6g(x)  =  B(x)  U  «2  '  For  any  ’  =  and  1  =  1»2»  let 

Ad,i,n(xi)  =  Ae,i^xi;  X1 i ’ * • *  *xni ^  *  n  =  be  tw0  se9uences  of  real¬ 

valued  measurable  functions.  We  define 
(3.10)  6n(x)  =  61>n(x)  U  62r|(x), 

where 

5l,n(x>  =  {,‘lxi  ±V  Al,i,n<xi)  <  0) 
and 

62>n(x)  *  t<|e0  <  xi  <  90+A’A2,i,n(xi}  <  0}- 
We  have  the  following  theorem: 

Theorem  3.1.  If  j 8dG^(e)  <  «,  i  =  1,2,...  ,k  and  A^^n(x^)  ->  (x^), 

D 

for  almost  all  x^  <_  eQ  and  ^  n(x^)  A2  G.^xi^’  For  almost  a11 

"P"  1 

e0  <  xi  <  e0+A’  where  *  means  convergence  in  probability.  Then  Un(x)} 
defined  by  (3.10)  is  a.o.  relative  to  G. 
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Proof.  0  <_  /L(e,6  (x))f(x|e)dG(e)-/L(e,6R(x))f(x|e)dG(e) 
n  "  n  '  ~n~ 


(3.11) 


rv  r\ 

*  {  l  a,  r  (x.)  n  m.(x .)-  I  a,  G  (x.)  n  m.(xi 
l€«,  _(x)  1>6i  1  j=l  J  3  i€6,  R(x)  '*Gi  1  j=l  J  J 

l*n'  j+i  1,8  '  Jfi 


)} 


K  * 

+  {  £  a-  r  (x.)  n  rMx .)-  I  a?  r  (x.)  n  nUxJ). 

l€6on(x)  2’Gi  1  j=l  J  J  i€6,  k ( x)  2*Gi  1  j=l  J  J 
2,n  -  Z»B  -  i±i 


The  first  term  of  (3.11)  can  be  expressed  as 


k  k 

(3.12)  {  l  a,  (x.)  n  m.(x1)-  l  A,  •  (x.)  n  m.(x.)} 

i€«,  n(x)  ,Gi  1  j=l  J  J  l€«,  h(x)  1‘1‘n  1  j=l  J  J 
l,n  -  ‘  j+1 

k  k 

+  {  l  a i  j  (xj  n  iMx.)-  I  a,  .  (x.)  n  m.(x.)} 

l€«i „(x)  1,1,0  1  J=1  J  J  i€6,  R(x)  1*1*n  1  j=l  J  J 
jfi  1,B-  j+1 


IV  IV 

+  {  l  A,  ,  _(x.)  n  m.(xf)-  l  A,  r  (x.)  n  m.(x.)} 
i€5^B(X)  ',1,n  1  j  =  l  J  J  166,  R(x)  '*Gi  7  j=l  J  J 


Jt1 


1  *B' 
k 


J+i 


1  I  (a,  r  (x.)-a,  ,  (x.))  n  m.(x.) 

l€6,  h(x)  1 *Gi  7  1,7’n  1  j=l  J  J 

1,h‘  jfi 


IV 

+  I  (a  1  i  n(xJ-A,  r  (x.))  n  nUx.). 
i€6l ,B(?)  1,Gi  j=l  J  J 


Jfi 


Since  by  the  definition  of  6,  n(x),  the  second  sum  of  (3.12)  is  less 
than  or  equal  to  zero. 

The  second  term  of  (3.11)  has  a  similar  result. 

Hence,  if  A|lj>n(xi)  £  a^ #g  (*|).  i  -  1.2,  then 
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0  <  /L(e,5  (x))f(x|e)dG(e)-/L(e,6B(x))f(x|e)dG(e) 
ft  "  "  o 

jfi  J+i 

k  k 

<  4e  l  (  n  m.(xj)) 

“  1=1  j=l  J  J 


with  probability  near  1,  for  large  n.  Hence 

/  L(e,6  (x))f(x|e)dG(e)  £  /L(e ,6B( x) ) f (x j e)dG(e) 

n  -  n 

for  almost  all  x. 

By  Corollary  1  of  Robbins  (1964),  { 6 n ( x) }  is  a.o.  relative  to  G. 

From  Theorem  3.1,  our  problem  is  reduced  to  finding  consistent  estimators 
of  A]  G  (x.j)  and  a2  g  (xi ) .  Let 

(3.13)  *,„<*,) 

then  Min(x^)  £  M^(x^)  for  all  x.  >  0.  Next,  let  cp(x)  >  0  be  a  Borel  function 
satisfying  the  following  conditions: 

00 

(3.14)  (i)  sup  cp(x)  <  »,  (ii)  /  tp(x)dx  =  1,  and  (iii)  lim  x<p(x)  =  0 

— oo<X<°°  -°0  X-*® 

and  (h(n)}  be  a  sequence  of  positive  constants  satisfying  the  following 
conditions: 

(3.15)  (i)  h(n)  -*•  0  as  n  ■+  »  and  (ii)  nh(n)  +  «  as  n  +  «. 


We  define 


n  x-Xj 


(3.16)  m1n(x)  *  I 

J  * 
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D 

then  min(x)  -*  m^x)  for  all  x  (see  Parzen  (1962)).  For  1  =  l,2,...,k,  let 

(3*17)  Al,1,n<xl)  =  (0o-A_xi  )n'i  n(  xi  )+l"^Min(eo)^in(xi ) 
and 

0.18)  42iiin(x,)  -  (xr90-a)mjn(x1H-H(n(x1). 

Then 

4l,i,n(xi>  *  4l,G,(x1>  for  aH  X1  i  90 
and 

A2,i,n(xi)  "  A2,G.(xi>  for  311  e0  "  Xi  <  60+A* 

Finally,  we  define 

6n(x)  =  (i|Xi  <  eQ,A]tUn(x.)  <  0}  u  {i|e0  <  x.  <  e0+A,  A2fUn(x.)  <  0}. 
Then  {<5n(x)}  is  a.o.  relative  to  G. 


3.2.  0q  unknown 


If  6g  is  unknown,  let  Wg  be  the  control  population  and  XQ  be  the  random 
variable  from  ttq.  We  assume  that  Xg  has  conditional  pdf 

f (x0 I e0)  =  I(0,e0)(x0)’  80  ”  °-  In  this  case 

il  “  I  §  “  (  0g  ,  0  ^  ,  •  •  •  ,  0|^)  j  0^  >  0,  1  “  0,1,.  ..,k),  t  5  {  X  “  (  Xg  ,  X-j  ,  •  •  •  ,  X|^  ) 

k  k 

|x.  >  0,  i  =  0,l,...,k},  G(e)  =  n  G<(e.),  f (x | e)  =  n  f(xjej,  and 
1  i=0  11  "  ”  i=0  1  1 

at  stage  n  we  observed  xn  =  (xno»xnl . xnk^“  Under  the  l°ss  Unction 

(2.4),  the  Bayes  rule  <5g(x)  is  given  by 


i  € 


6g(x) 


if  A 


Gg.G^O’V  < 


where 

ag0,g1(xo*xi)  =  /eof(xoleo)dGo(eo),T,i(xi)-A,Ib(xo)mi(xi>- 

/©i  f(xi  |  0j  )dG^(0^  )lt^g(Xg)+2/  (8j~00)f(Xj|9j)f(Xg|  0g)dG^  (0^  )dGg(e0) . 

{60<ei} 


Using  formula  (3.4)  if  0  <  <_  xQ,  we  have 

/  (0i-0o)f(x1.|0.)f(xo|eo)dG1.(e1.)dGo(eo) 

{e0<ei} 

00  M.  (en) 

=  -  /  — g“  dGo(0o)* 

xo  u 

and  if  0  <  Xq  <  x^,  we  have 

/  (0i-eo)f(xi|01)f(xo|eo)dG1(e.)dGo(eo) 

{0O<01} 

=  (l-G^x^Mn^U^-i^Uj))  -  mjfXjHG^Xjl-G^XQ)) 

"  Mi(en) 

"  x.  e0  dG0(60)  + 


Hence 

( 3- 19)  AG0,G.^x0’xi^  =  +  ( 1+Mi  (Xi )  )n\j(x0)  + 

®  M-(0n) 

(x0-xrA)m.(xi)m0(x0)-2/  — -  dGQ(0o) 

Xo  u 

=  AlfG^,G1(x0*xi)  (say)>  if  0  <  xi  i  x0 

and 

(3.20)  AG0,G.^xO,xi^  =  (1_Mi  (xi )  )n\)(xo)+0+M0(xo)-2f\)(xi )  >rai  (xi ) 

®  M.(0O) 

(xi-x0-A)mi(x.)n^(x0)+2Mi(xi)n^(xi)-2/  — - -  dG0(e0) 

xi  0 

=  &2,G  ,G.^xO,xi^  (say)’  if  0  <  xQ  <  xr 

Thus 

(3.21) 


where 


6g(x)  s  b^-^  ^  52  B^x^ 
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Si>B(x)  =  t’l0  <  xi  i  xo *  ,G0,G{^xO’xi^  <  01 

and 

62fB(x)  -  (1|0  <  x0  <  xit  A2,G0,G.^x0’xi^  <  0}> 

Similar  to  Theorem  3.1,  we  have  the  following  result. 

CD 

Theorem  3.2.  If  ^  edG. (e)  <«,  i  »  0,l,...,k  and  for  all  1  <  i  <  k, 

41.1, „<x0-x1>  J  1l.G0,61.(x0-xi)  for  X1  i  “0  and 

42.1, n(x0,xl'  *  a2,G0,G^x0,xt’  for  x0  *  xr  Let 

6n(x)  =  {i  j x.  <_  x0,  Ajj^Xq.Xj)  <  0}  U  { i  I Xq  <  xi»A2,i,n^x0*xi^  <  0}* 

then  { 6 n ( x ) }  is  a.o.  relative  to  G. 

Hence  our  problem  is  to  find  a  consistent  estimator  of 

* 

/  dGo(0o)  for  xo±a- 

8  0 


Theorem  3,3.  Let  Min(x)  and  m^x)  be  defined  by  (3.13)  and  (3.16), 
respectively.  Then 

/  d60n<e0>  5  /  d60(e0)  for  x0  i  a’ 


where  G0n(eQ)  -  fyn(e0)“e0,bn{e0,< 


«  M. (en)  ®  Mj(en) 

Proof.  i,  _!!LJL  dGon(eo)  .  /  J-2-  dG0n(e0)| 


a  °0 


a  °0 


7  dC  f0  . 

- 1 - ~0 - dG°"<9°) 

;j  sup  |M,  (x)-M,(x)|  <  t 


with  probability  near  lt  for  large  n,  by  Gllvenko-Cantelli  Theorem.  Since 
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M,(e0)  p 

— - - is  bounded  continuous  and  Ggn(e0)  •*  G0(e0),  we  have 


M.(en) 

/  -rr-  <“W»o>  *  /  ~rf-  <W 


P  7  Mi(e0) 


a  e0 


Thus 


00  ^.(©n)  "  M.(6n) 

1/  ^on'^o’  -  /  dG0<«0’l 

*  ",„<««,>  -  M8o> 

J\r-dW8o)  -  Hi^dWfo>i  * 


W 


'{ 


dW  ’  / 


a  “0 

7  W 


a  e0 


d6o(eo)i 


£  e  with  probability  near  1,  for  large  n. 
From  Theorem  3.3,  if  we  define 

Al,i,n<Vxi>  =  min(xi)<1'Vx0))  + 


+  ( x0~xi “A )mi n(xi )  m0n(x0)  -  2/ 


7  Min(oO} 


x0  0 


dW’ 


where  G0n(eQ)  =  Mgjeg)  -  ©g^Og)  and  Min(x),  m.n(x)  are  defined  by 
(3.13)  and  (3.16),  respectively,  and 

A2,i  ,n^x0’xi  ^  =  "bn^O^^in^i^  +  min^xi^1+M0n^x0^'2M0n^xi^ 


(xi-x0-A)"bn(x0)min(xi)  +  2Min(xi?m0n(xi)  '  2/ 


00  Min(e0) 


0 


0 


dW  • 


Then 


A4,i,n(x0’xi^ 
Now,  let 

6  (x)  =  {i|xi 
n  1 

From  Theorem  3.2,  we 


*  At,Gg,G^x0,xi ^ *  1  =  1*2, 

—  x0,Al,i,n^x0,xi)  <  0}U  {i*x0  <  xi*A2,1,n(x0’xi)  <  0}- 
have  <«n(x) }  is  a.o.  relative  to  G. 


3.3.  Rate  of  Convergence  of  the  Empirical  Bayes  Rules 


In  this  section  we  will  consider  the  rate  of  convergence  of  the 
empirical  Bayes  rules  derived  in  Section  3.1. 

Definition  3.2.  The  sequence  of  procedures  {6 p}  is  said  to  be  asymptotically 
optimal  of  order  an  relative  to  G  if  rn(G,5n)-r(G)  =  0(an)  as  n  -»•  »,  where 
lim  a  =  0. 

rv*«  ' 

The  main  result  (Theorem  3.8)  of  this  section  is  based  on  a  series  of 
lemmas. 


Lemma  3.4.  Let 


a1,G,(x1)-  a2.Gi<x1)*  4l,i,„<xi>  and  42,(,n<xi>  be  defined 


by 


(3.6),  (3.7),  (3.17)  and  (3.18)  respectively.  Then  0  ^  rn(G,6n)-r(G) 


k  e0 


1-6 


-4,  (,  lal.G1<xi)l  '  Eh,M<xi>-4l,Gi(x1>l  dxi  4 


k  90+A 


1-6. 


-L  l  I A2,G- (xi 5 1  ElA2,i,n(xi)'A2,G.(xi)l  dxi’  6  >  °* 

1  ”  •  V  Q  1  I 


Proof.  The  proof  is  similar  to  that  of  Lemma  3  of  Van  Ryzin  and  Susarla 
(1977)  and  hence  omitted. 


Lemma  3.5.  Let  cp(x)  satisfy  the  conditions  (i)  cp(x)  =  0  if  x  4  (0,a)  for 

a 

some  finite  a  >  0,  (ii)  ^  tp(x)dx  =  1,  and  (iii)  sup|q>(x)|  <  «  and  define 
i  n  X.j-x. 

min(Xi )  =  nhjny  }  Where  {h(n)>  satisfy  the  conditions  (3.15) 

(see  Johns  and  Van  Ryzin  (1972)).  Then 

a 


I Emin(xi )~mi (xi )  1  <.  h(n)f£(x^)^|up(u)  |du,  for  large  n,  where 


f  (x.)  =  sup  |mJ(x.+y) | ,  e  >  0. 
0<y<e  1 
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Proof.  Em.n(x.)  -  m.^) 

y_  ^ 

=  KTnT  /cP(KTHT)ml(y)dy  - 

a 

=  ^  <p(u)[m1(xi+uh(n))-m.j(xi)]du 
a 

*  j  cp(u)[uh(n)m1!(xi+nn(xi,u)3du 
where  0  <  n^x^.u)  <  uh(n). 

For  e  >  0,  let  n  be  large  enough  so  that  uh(n)  <  e,  then 


|Emin(xi)-mi(xi)|  £  h(n)fe(xi)^|u  cp( u) Jdu. 


Lemma  3.6. 


Under  the  conditions  of  Lemma  3.5,  we  have 

var%(V±HRHTm1(xi,l  ^lu>du- 


Proof.  *»rmjn(x,)  ■  van^ 

1  a  2 

l-Smfr  (u)mf(x,*uh(n))du 
i  oSWn,1(,1>/  <P2(")du-  s1nce  l"i<x1>‘- 


Remark:  From  Lenina  3.5  and  Lenina  3.6,  we  have 

D 

mi n<x1 )  mi (xi )  1f  fe(xi)  <  ”• 


Lenina  3.7.  Under  the  conditions  of  Lenina  3.5,  we  have 
<a>  Var  a),t,n<xi>  '  0«Va-xl)2mi(x1>  SfW>- 

<b>  Var  a2,1,n(x1>  ’  0((x1-V4>S(xt)  5fW>- 
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Proof,  (a)  Var  fl- >n(xi) 

<  2{(eQ-A-xi)2Var  m.n(x.)  +  var(M1|)(x1)-2M1||(o0))} 

<  2{(e0-A-xi)2m.{x.)  ^  <p2(u)du  +  |^}  (By  Lemma  3.6) 

<  M  ( eQ“ A-x^ ) 2m^ ( x.. ) ,  for  some  M  >  0. 

Similarly,  we  have  the  result  (b). 

Theorem  3.8.  Under  the  conditions  of  Lemma  3.5.  If 
e0 

0)  l  |AljG.(xi)|1-6|0o-A-xi|6m^/2(x.)dxi  < 

Oq+A 

(«)  /  |a2  q  (k,)!1-5  1*  i-e0-A|sro^2(xi)dx1  < 

"o’* 

eo 

(iii)  (j  lAl.G.(xi)|1,5|0O'A'xil6f1(xi,dxi  <  "* 
and 

°0+A 

(iv)  /  |a2  q  (xi)|1'<S|xi-o0-A|V(x.)dxi  < 

oQ  ’  1 

where  0  <  6  <  2,  then 

rn(G,6n)'r(G)  =  0(max^nHTnT)6/2,  (h(n))6})  as  n  "  °°* 

Proof.  For  0  <  6  <  2,  by  Holder  Inequality  and  Lemma  3.4,  we  have 
0  <  rn(G,6n)-r(G) 

k  eQ 

<  X  {■ax(l,26"1)^  |AlfGi(x1)|1‘6(Var  ^  ^  ,n(Xi))6/2dXi  + 
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e0 

t" 


1,G. 


(*i)| 


1-6 


|  ( e0-A-xi ) (Emin(x . )-m. (xi ) )  1 5dxi  ]} 


+ 


'-s(var  A2,j>n(x())s/2dx, 


+ 


°o+A  , 

/  lA2,G.^xi^  6  !  (xi-e0-A)  (Em1n(  xn-  )-mi  (xi ) )  1 6dxi  ] }  - 

e0  ’  1 

By  Lemma  3.7,  we  have 
90 

l  lAl,Gi(xi)!1’6(var  Al,i,n(xi))6/2dxi  =  0((nh(n))-fi/2) 
and 

e0+A 

/  lA2,G.(xi)  Il6(var  A2,i,n(xi^6/2dxi  =  0(  (nh(n)  )_6/2) . 
e0  ’  i 

By  Lemma  3.5,  we  have 
90 

(5  I A1  ,Gi ^xi ^  1 1-6 1 e0_A_xi  I6  I E  min^xi^mi^xi^5<lxi  =  °((h(n))tS) 

and 

90+A  , 

/  |a2  g  _(x1)  I  "6|(x1-e0-fl)(E  min(xi)-mi(xi))|'5dxi  =  0((h(n))6). 

e0  ’  1 

Hence 

rn(G,6n)-r(G)  =  0(max{(nh(n))"6/2,  (h(n) ) 6 } )  as  n  -*•  ». 

Corollary  3.9.  Under  the  conditions  of  Theorem  3.8.  If  we  take  h(n)  *  n"“, 
0  <  a  <  1,  then  the  optimal  choice  of  a  is  1/3  and  rn(G,5n)-r(G)  =  Ofn"6^3) 


as  n  "*•  °°* 
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Remark:  If  the 
both  bounded  on 
Theorem  3.8  are 


prior  distribution  is  such  that  g..(x)/x  and  m^x)  are 
(0,  6g+A+e),  it  is  easy  to  check  that  the  conditions  of 
satisfied  for  0  <  6  <  1 . 
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